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1 Introduction 



We continue our asymptotic analysis of problems with small transaction costs using the 
approach developed in |44j for problems with only one stock. In this paper, we consider the 
case of multi stocks with proportional transaction costs. The problem of investment and 
consumption in such a market was first studied by Magill &; Constantinides |30) and later 
by Constantinides . There is a large literature including the classical papers of Davis &; 
Norman |13) . Shreve & Soner |41) and Dumas & Luciano |15| . We refer to our earlier paper 
[44] and to the recent book of Kabanov & Safarian [27] for other references and for more 
information. 

This problem is an important example of a singular stochastic control problem. It is well 
known that the related partial differential equation contains a gradient constraint. As such 
it is an interesting free boundary problem. The main focus of this paper is on the analysis of 
the small transaction costs asymptotics. It is clear that in the limit of zero transaction costs, 
we recover the classical problem of Merton |32| and the main interest is on the derivation 
of the corrections of this obvious limit. 

The asymptotic problem is a challenging problem which attracted considerable attention in 
the existing literature. The first rigorous proof in this direction was obtained in the appendix 
of |41| . Later several rigorous results [5l [22l [26l |36j and formal asymptotic results [H [23l H6] 
have been obtained. The rigorous results have been restricted to one space dimensions with 
the exception of the recent manuscript by Bichucli and Shreve [6j. As well known, utility 
indifference price in this market is an important approach as perfect hedging is very costly 
as shown in [43]. Davis, Panas and Zariphopoulou |14) was first to study this approach with 
an exponential utility function and the formal asymptotics was later developed in |46j . 



In this paper, we use the techniques developed in |44j. As in that paper, the main technique 
is the viscosity approach of Evans to homogenization \16\ [T7] . This powerful method com- 
bined with the relaxed limits of Barles &: Perthame [2] provides the necessary tools. As well 
known, this approach has the advantage of using only a simple bound. In addition to 
[21 \TE[ 117] , the rigorous proof utilizes several other techniques from the theory of viscosity 
solutions developed in the papers [21 [181 1201 [2H1 ISS] \38\ |42] for asymptotic analysis. 

For the classical problem of homogenization, we refer to the reader to the classical papers 
of Papanicolau & Varadhan |34j and of Souganidis [45] . However, we emphasize that the 
problem studied here does not even look like a typical homogenization problem of the ex- 
isting literature. Indeed, the dynamic programming equation, which is the starting point of 
our asymptotic analysis, does not include oscillatory variables of the form x/e or in general 
a fast varying ergodic quantity. The fast variable appears after a change of variables that 
includes the difference with the optimal strategy at the effective level problem. Hence, the 
fast variable actually depends upon the behavior of the limit problem, which is a novel view- 
point for homogenization where usually the fast variables are built into the equation from 
the beginning and one does not have to construct them from limits. This ergodic variable, in 
general, does not have to be periodic. In recent studies, deep techniques combining ergodic 
theorems and difficult parabolic estimates were used to study these more general cases. We 
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refer the reader to Lions & Souganidis |29) for the almost-periodic case and Caffarelh &; 
Souganidis for the case in random media and to the references therein. 

As in our accompanying paper |44| . the formal asymptotic analysis leads to a system of 
corrector equations related to an ergodic optimal control problem similar to the monotone 
follower Hj. However, in contrast with the one-dimensional case studied in |44) . no explicit 
solution is available for this singular ergodic control problem. This is the main difficulty 
that we face in the present multi-dimensional setting. We use the recent analysis of Hynd 
|24| [25] to analyze this multidimensional problem and obtain a C^'^ unique solution of the 
corresponding "eigenvalue" problem satisfying a precise growth condition. This characteri- 
zation is sufficient to carry out the asymptotic analysis. On the other hand, the regularity 
of the free boundary is a difficult problem and we do not study it in this paper. We refer 
the reader to |39| HQ] for such analysis in a similar problem. 

The paper is organized as follows. Section [2] provides a quick review of the infinite horizon 
optimal consumption-investment problem under transaction costs, an recalls the formal 
asymptotics, as derived in |44j . Section [3] collects the main results of the paper. The next 
section is devoted to the numerical experiments which illustrate the nature of the first order 
optimal transfers. The rigorous proof of the first order expansion is reported in Section O 
In particular, the proof requires some wellposedness results of the first corrector equation 
which are isolated in Section [6l 

Notations: Throughout the paper, we denote by • the Euclidean scalar product in R*^, 
and by (ei, . . . ,6^) the canonical basis of W^. We shall be usually working on the space 
M X M*^ with first component enumerated by 0. The corresponding canonical basis is then 
denoted by (eo, . . . , e^). We denote by A1d(M) the space of d x d matrices with real entries, 
and by the transposition of matrices. We denote by Br{x) the open ball of radius r > 
centered at x, and Br{x) the corresponding closure. 



2 The general setting 

In this section, we briefiy review the infinite horizon optimal consumption-investment prob- 
lem under transaction costs and recall the formal asymptotics, derived in |44j. These cal- 
culations are the starting point of our analysis. 

2.1 Optimal consumption and investment under proportional transaction 
costs 

The financial market consists of a non-risky asset and d risky assets with price process 
{St = {Sj, . . . , Sf),t > 0} given by the stochastic differential equations (SDEs), 




= r{St)dt, — * = ^^\St)dt + ^ a''\St)dWi, 1 < i < d, 



where r : — t- M+ is the instantaneous interest rate and 

are the coefficients of instantaneous mean return and volatility, satisfying the standing 
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assumptions: 

r,ii,(T are bounded and Lipschitz, and (cto""^)"^ is bounded. 

In particular, this guarantees the existence and the uniqueness of a strong solution to the 

above stochastic differential equations (SDEs). 

The portfolio of an investor is represented by the dollar value X invested in the non-risky 
asset and the vector process Y = {Y^ ■, ■ ■ ■ i^'^) of the value of the positions in each risky 
asset. These state variables are controlled by the choices of the total amount of transfers 
Ll'-' , < i,j < d, from the i-th to the j-th asset cumulated up to time t. Naturally, the 
control processes {L]'-' ,t > 0} are defined as cad-lag, nondecreasing, adapted processes with 
Lo- = and U^' = 0. 

In addition to the trading activity, the investor consumes at a rate determined by a nonnega- 
tive progressively measurable process {q , t > 0}. Here q represents the rate of consumption 
in terms of the non-risky asset S^. Such a pair v := (c, L) is called a consumption-investment 
strategy. For any initial position {Xq-,Yq-) = {x,y) e M. x M^, the portfolio positions of 
the investor are given by the following state equation 

dXt = {riSt)Xt -ct)dt + K\dLt), and dY^ = Y,'—f + R\dLt), i = l,...,d, 

where 

d 

R\e) := [ff'i - (1 + e^A*'^)^ '^■) , i = 0, . . . , d, for all £ e Md+i{^+), 

3=0 

is the change of the investor's position in the i— th asset induced by a transfer policy given 
a structure of proportional transaction costs e^A*'-' for any transfer from asset i to asset j. 
Here, e > is a small parameter. A*'-' > 0, A*'* = 0, for all z, j = 0, . . . , d, and the scaling 
is chosen to state the expansion results simpler. 

Let (X, YY'^'^^y denote the controlled state process. A consumption-investment strategy v 

is said to be admissible for the initial position {s,x,y), if the induced state process satisfies 
the solvency condition (X,Y)^'^'^'^ G K^, for all t>0, P— a.s., where the solvency region is 
defined by: 

:= |(a;,j/) e M X M"' : {x,y) + R(£) € M++'^ for some £ € >ld-M(]K-h)} • 

The set of admissible strategies is denoted by @^{s,x,y). For given initial positions Sq = 
s G M^, Xq- = X G M, Yq- = y E W^, the consumption-investment problem is the following 
maximization problem. 



fOO 

v^{s,x,y) := sup E 

ic,L)ee^{s,x,y) 



roo 

/ e-^* U{ct)dt 
Jo 



where U : (0, oo) i-)- R is a utility function. We assume that U is C^, increasing, strictly 
concave, and we denote its convex conjugate by, 

U{c) := sup {U{c) - cc}, cGM. 

oo 
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2.2 Dynamic programming equation 

The dynamic programming equation corresponding to the singular stochastic control prob- 
lem involves the following differential operators. Let: 

C := n-{T>s + ^y) + r'Dx + ^TV [aa^ (Dyy + Dss + ^Dsy)] , (2.1) 



and for i,j = l,...,d, 



Ds = (D*)l<j<£;, Yiy = (D^)l<j<rf, T>yy 1= (Dy^)l<jJ<rf, Djj^ 1= {j^Ss) l<i,j <d^ ^ gy 1 = 

(D^y)i<jj<rf. Moreover, for a smooth scalar function {s,x,y) G W\, x R x R'' i — > ip{x,y), 
we set 

,..:=| GM, ^,:=| G R^. 

Theorem 2.1. Assume that the value function v'^ is locally bounded. Then, is a viscosity 
solution of the dynamic programming equation in x K^, 



mm 

0<i,j<d 



{ Pv' - Cv' - U{vl) , Alj ■ «, vD } = 0, At J := a - ej + e^A''^' a, 0<i,j<d. 

(2.2) 

Moreover, v'^ is concave in {x,y) and converges to the Merton value function v := , as 
e > tends to zero. 

The Merton value function v = corresponds to the limiting case e = where the transfers 
between assets are not subject to transaction costs. Our subsequent analysis assumes that v 
is smooth, which can be verified under slight conditions on the coefficients. In this context, 
we recall that v can be characterized as the unique classical solution (within a convenient 
class of functions) of the corresponding HJB equation: 

I3v - rzvz - C^v - U{vz) - sup \e ■ ((// - rld)vz + aa'^'Dszv) + h^^'^^l^^^A = 0, 
where 1^ := (1, . . . , 1) G D,, := f D„ and 

£° := fi--D, + ^Tr[aa'^Bss\. (2.3) 

The optimal consumption and positioning in the various assets arc defined by the functions 
c(s,z) and y{s,z) obtained as the maximizcrs of the Hamiltonian: 

cis, z) := -U' {v,{s, z)) = {U')-' iv,{s, z)) , 
-Vzz{s,z)aa^{s)y{s,z) := {tJ,-rld){s)v;^{s,z) + aa'^{s)'Dsz'v{s,z) for s G R1, z>Q. 
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2.3 Formal Asymptotics 

Here, we recall the formal first order expansion derived in 144] : 

v^{s, X, y) = v{s, z) — e'^u{s, z) + o(e^), (2.4) 
where u is solution of the second corrector equation: 

Au := Pu - C°u - {rz + y ■ {fi - rid) - c)n^ - ^kVl^ u^z - cra'^y ■ TigzU = a, 

and the function a is the second component of the solution (w, a) of the first corrector 
equation: 

{Icjfs^^^l^ 1 
Vzzis, z) Tr 100^(8, z)wff{s, z, ^)1 + a{s, z) ; 
2 2 

-\'^^Vz{s, z) + ^{s, z, i) - |^(s, z, e)| = 0, 

where ^ G R"^ is the dependent variable, while (s, z) G (0, cxd)'^ x M+ are fixed, and the 
diffusion coefficient is given by 

a(s, z) := [{Id - yz{s, z)l^) diag[y(s, z)] - y^{s, 2;)diag[s]] a{s). 

The expansion (|2.4p was proved rigorously in |j44j in the one-dimensional case, with a crucial 
use of the explicit solution of the first corrector equation in one space dimension. Our objec- 
tive in this paper is to show that the above expansion is valid in the present d— dimensional 
framework where no explicit solution of the first corrector equation is available anymore. 

We finally recall the from fi¥| the following normalization. Set 



Vzis,z) ^ w{s,z,r]{s,z)p) 

ri{s,z) := -, p := — -, w{s,z,p) := — — -, 

Vzz{s,z) ■n{s,z) r]{s,z)Vz{s,z) 

a{s,z) _ a(s,z) 

a{s,z) := — — -, a{s,z} := — -, 

ri{s,z)vz{s,z) V[s,z) 

so that the corrector equations with variable p G M'* have the form. 



max max 



-Tr [aa {s , z)w pp{s , z , p)] + a{s , z) ; 



0<i,j<d 2 2 

dw, . dw 
— {s,z,p) - — 
OPi opj 

Au{s, z) = Vz{s, z)r]{s, z)a{s, z). (2.6) 



+ = (2.5) 



Notice that we will always use the normalization zi;(s,z,0) = 0. 
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3 The main results 



3.1 The first corrector equation 

We first state the existence and uniqueness of a solution to the first corrector equation ()2.5p , 
within a convenient class of functions. We also state the main properties of the solution 
which will be used later. We will often make use of the language of ergodic control theory, 
and say that W is a solution of (j2.5p with eigenvalue a. 

Consider the following closed convex subset of M'^, and the corresponding support function 
C := \peR'^ : -X^^' < Pi- Pj < y^^, <i,j <d] , 5cip) ■= sup u ■ p, peR'^, 

^ ^ u&C 

with the convention that po = 0. Then, C is a bounded convex polyhedral containing 0, 
which corresponds to the intersection of d{d + 1) hyperplanes. Furthermore, the gradient 
constraints of the corrector equation (12. Sp is exactly that Dw G C. In this respect, (|2.5p is 
closely related to the variational inequality studied by Menaldi et al. |31| and Hynd |24j . 
where the gradient is restricted to lie in the closed unit ball of (we also refer to |25| for 
related variational inequalities with general gradient constraints). 

The wellposedness of the first corrector equation is stated in the following two results. Since 
the variables (s, z) are frozen in the equation (j2.5p . we omit the dependence on them. 

Theorem 3.1. (First corrector equation: comparison) Suppose wi is a viscosity suhsolution 
of (j2.5p with eigenvalue oi and that W2 is a viscosity supersolution of (12. Sp with eigenvalue 
a2- Assume further that 

m ^<l< hm 

Then, ai < 02. 

The proof of this result is given in Section 16.11 

Theorem 3.2. (First corrector equation: existence) There exists a solution w G C"^'^ of the 
equation (j2.5p with eigenvalue a, satisfying the growth condition \vca.\p\^oo^ / ^c){p) = 1- 
Moreover, 

• w is convex and positive. 

• The set Oq := {^p ^ M'*, Dw{p) G int(C)} is open and hounded, w G C°°{Oo) and 

w{p) = inf {w{y) + 6cip — y)} , for all pGR'^. 

y&Oo 

• There is a constant M > such that < D^w{p) < Ml-^^{p) for a.e. p eM.'^. 
The proof of this result will be reported in Section 16.21 

Remark 3.1. As already pointed out in |44) . the corrector equation (j2.5p is related to 
the dynamic programming equation of an ergodic control problem fT, 'H]. More precisely. 
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let {M^)t>Q be non-decreasing control processes for < i,j < d, and define the control 
process p as the solution of the following SDEs 



d d 



j=l j=0 
Then, the ergodic control problem is given by, 

a:=infJ(M), J{M) := lE^ -E - / \apt\^dt + ^ X''^ M'^^ 
M r-)-+oo 2 Jq . ^.^^ 

However, it is not clear whether the corresponding potential function, which is the candidate 
for a solution to (j2.5p . satisfies the growth condition W+oo ^5c- For this reason, we cannot 
use this probabilistic representation, and our analysis of the equation (|2.5p follows the PDE 
approach of Hynd [23]. □ 



In the one-dimensional context d = 1, the unique solution of the first corrector equation 
is easily obtained in explicit form in |44| . For higher dimension d > 2, in general, no 
such explicit expression is available anymore. The following example illustrates a particular 
structure of the parameters of the problem which allows to obtain an explicit solution. 

Example 3.1. Suppose the equation is of the form, 

max max(-^-|A^}(p)+a, -V + ^(p) , -A^ _ = 0, (3.1) 

o<i<d I 2 2 opi opi I 

with given positive constants cj, C2, A*, A* and the normalization w[{)) = 0. This corresponds 
to the case when a and a are multiples of the identity matrix and we are only allowed to 
make transactions to and from the cash account, i.e., when A*'-^ = 00 as soon as i and j are 
both different from 0. Then, the unique solution w is given as. 



W{p) = ^ Wi{pi), 



i=l 

where Wi is the explicit solution of the one dimensional problem constructed in |44j . More- 
over, a is an explicit constant independent of z. 

Notice that for the corrector equations, a and a cannot be specified independent of each 
other. However, the above explicit solution will be used as an upper bound for the unique 
solution of the corrector equation. 

3.2 Assumptions 

This section collects all assumptions which are needed for our main results, and comments 
on them. 
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3.2.1 Assumptions on the Merton value function 

Assumption 3.1 (Smoothness), v and 9 are in (0,oo)^+^, > 0, yl > 0, i < d, on 

(0,00)'^^"'^, and there exist Co,ci > such that 

Co < • Id < 1 — Co and aa^ > cila, on (0,oo)'^^"^. 

Notice that this Assumption is verified in the case of the Black-Scholes model with power 
utihty. 

3.2.2 Local boundedness 

As in [44j, we define 

u^{s,x,y) := ^-^^l^l^p^l^, sGRi, {x,y) G K,. (3.2) 

Fohowing the classical approach of Barles and Perthame, we introduce the relaxed semi- 
limits 

u*{s,x,y):= lim u'^{s' , x' ,y'), n*(s,x,7/):= lim u'^{s' ,x' ,y'). 

{t,s',x',y')^{0,s,x,y) (e,s' ,x' ,y')^{0,s,x,y) 

The following assumption is verified in Lemma [3. II below, in the power utility context with 
constant coefficients. 

Assumption 3.2 (Local bound). The family of functions is locally uniformly bounded 
from above. 

This assumption states that for any (so,xo,yo) ^ (0,00)*^ x M x M'^ with xq + yo ■ 1^ > 0, 
there exist tq = ro(so,xo,yo) > and eo = £o{so,xo,yo) > so that 

b{so, xo, yo) ■.= sup{ u^{s,x,y) : {s,x,y) e Bro{so,xo,yo), e e {0,eo] }< 00, (3.3) 

where BrQ{sQ,XQ,yQ) denotes the open ball with radius ro, centered at (so,xo,yo)- 

The following result verifies the local boundedness under a natural hypothesis. We observe 
that this is just one possible set of assumptions, and the proof of the lemma can be modified 
to obtain the same result under other conditions. 

Lemma 3.1. Suppose that U is a power utility, and < A'^'-' , A-'''^ < 00, A*'-' = 00 for all 
^ ^ i j ^ d. Then, Assumption \3 .S\ holds. 

Proof. The homotheticity of the utility function implies that both the Merton value 
function v and the solution u of the second corrector equation are homothetic as well. 
For a large positive constant K to be chosen later, set 

V'^^{z,i) := v{z) - e^Ku{z) - e^W(z,0^ 

where W{z,S^) := zv' {z)w{p), and w solves (j3.ip with constants chosen so that 

c\Id > cTd^, Cold > aoF, X' = X' = 2A := max A*'-''. 

0<i,j<d 
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Note that W is explicit and is twice continuously differentiable. We continue by showing that 
for large K, V"'^ is a subsolution of the dynamic programming equation (j2.2p . which would 
imply that V"'^ < v*" by the comparison result for the equation (j2.2p (see |27| Theorem 
4.3.2, Proposition 4.3.4 and the subsequent discussion). A straightforward calculation, as 
in the proof of Lemma 7.2 in [44], shows that the gradient constraint 

K,o ■ {Vx^^ Vyf) < 0, holds whenever 2A + ^(p) < 0. 

Similarly, 

An i-iVx'^, V''^ ) < 0, holds whenever -2X + ^(p) <0. 

opi 



Assume therefore that the elliptic part in the equation (13. ip holds. We claim that for a 
large constant K, 

I{V''^) := f3V''^ - CV'^ - U{V^'^) < 0. 
We proceed exactly as in subsection 15.21 below to arrive at 



-\ \cy{s)i\ V,, + ^Tr [aa^(s, z)Wi-i,{s, z, Cj] - KAu{z) + TZ%z, 



It is clear that |7^^(2;,^)| < k*ezv'{z) for some constant k* . We now use the elliptic part of 
the equation (|3.ip and the choices of c* to conclude that in this region, 

+ ^Tr [aa^{s, z)W^^{s, z, < zv'{z)a. 

Also by homotheticity, a{z) = zv'{z)ao for some oq > 0. Hence, 

I{V''^) < e^zv'{z) [a - Ka^ + ek*\ < 0, 

provided that K is sufficiently large. Since V^^^ is a smooth subsolution of the dynamic 
programming equation, we conclude by using the standard verification argument. □ 

3.2.3 Assumptions on the corrector equations 

Let h be as in (13.31). and set 



B{s, z) := b{s, z - y(s, z),y{s, z)), se (0, oo)^ z > 0. (3.4) 

Assumption 3.3 (Second corrector equation: comparison). For any upper- semicontinuous 
(resp. lower- semicontinuous) viscosity subsolution [resp. supers olution) ui (resp. U2) of 
(12. 6p in (0,00)*^^^ satisfying the growth condition \ui\ < B on (0,00)^^^^, i = 1,2, we have 
ui < U2 in (0, 00)'^+^. 

In the above comparison, notice that the growth of the supersolution and the subsolution is 
controlled by the function B which is defined in (|3.4p by means of the local bound function 
b. In particular, B controls the growth both at infinity and near the origin. 

Our next assumption concerns the continuity of the solution {w, a) of the first corrector 
equation in the parameters (s, z). Recall that w = tjVzW and a = r]Vza. 
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Assumption 3.4 (First corrector equation: regular dependence on the parameters). The 

set Oq and a{s,z) are continuous in {s,z). Moreover, w is in {s,z), and satisfies the 
following estimates 

{\Ws\ + \Wss\ + \W^\ + \Wsz\ + \w,,\) (s, z, < C{s, z) (1 + 1^1) (3.5) 
{\w^\ + \wss\ + \w,i\) {s,z,C) < C{s,z), (3.6) 

where C{s,z) is a continuous function depending on the Merton value function and its 
derivatives. 

Notice that by the stabihty of viscosity solutions, the function w is clearly continuous in 
{s,z). Moreover, Assumption 13.41 is satisfied when we consider the constant coefficients and 
the power utility function. Indeed, in that case, there is no dependence in the s variable, as 
emphasized in Lemma |3.H and the dependence in z can be factored out by homogeneity. 

3.3 The first order expansion result 

The main result of this paper is the following d— dimensional extension of [44J. 

Theorem 3.3. Under Assumptions \3. 1\ \3.3\ and \3.4\ the sequence {u'^}e>o, defined in 
(13. 2p . converges locally uniformly to the function u defined in (j2.6p . 

Proof. In Section [5l we will show that, the semi-limits and u* are viscosity superso- 
lution and subsolution, respectively, of (|2.6p . Then, by the comparison Assumption 13. 3| 
we conclude that u* < u < u^,. Since the opposite inequality is obvious, this implies that 
u* = = u. The local uniform convergence follows immediately from this and the defini- 
tions. □ 



4 Numerical results (by Loic Richier and Bertrand Rondepierre) 
4.1 A two-dimensional simplified model 

In this section, we report some examples of numerical results. We follow the numerical 
scheme suggested in Campillo [Tn| which combines the finite differences approximation and 
the policy iteration method in order to produce an approximation of the solution of the first 
corrector equation. We recall that a first order approximation of the no-transaction region, 
for fixed s € (0, oo)"^, is deduced from the free boundary set Oq of Proposition 13.21 bv: 

NT,(s) := {{x,y)€R^+^ ■.y = e{s,z) + er]{s,z)Oo}, (4.1) 

where we again denoted z := x + "^iKdU^- Also, as explained in Remarks 13.11 and 16.21 
below, the first corrector equation corresponds to a singular ergodic control problem whose 
corresponding optimal control processes can be viewed as a first order approximation of 
the optimal transfers in the original problem of optimal investment and consumption under 
transaction costs. 
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For simplicity, the present numerical results are obtained in the two-dimensional case d = 2 
under the following simplifications: 

cP 

C/(c) = — , p G (0, 1), ^ G and a ^ M2(^) are constants. 
P 

Under this simplification, it is well-known that the value function of the Merton problem v 
is homogeneous in which in turn implies that the optimal control 9{z) is actually linear 
in z. Hence, the coefficient a reduces to a constant and the solution of the first corrector 
equation is independent of z. 

4.2 Overview of the numerical scheme 

As explained above, we use the formal link established between the first corrector equation 
and the ergodic control problem to perform our numerical scheme. The first step in the 
numerical approximation for the first corrector equation is to transform the original ergodic 
control problem to a control problem for a Markov process in continuous time and finite 
state space. To do so, we restrict the domain of the variable p to a bounded (and large 
enough) subset of M^, denoted by D, which is then discretized with a regular grid containing 
A^^ points. Then, the diffusion part of the first corrector equation is approximated using 
a well chosen finite difference scheme (we refer the reader to |10] for more details). The 
discretized HJB equation thus takes the following form: 



mm ^"(P, pMp') + r{p) = a, for ah pGV, 



where £™ is the discretized version of the infinitesimal generator appearing in the first order 
corrector equation, m corresponds to the control (that is to say that m is a 3 x 3 matrix), 
and 

I T 1 2 

r(p):=^^ + Tr[A^m], A = (A*'^)o<.,,<2, P^V. 

The policy iteration algorithm corresponds now to the following iterative procedure which 
starts from an arbitrary initial policy m^, and involves the two following steps: 

(i) Given a policy m? ^ we compute for all /) G D the solution (w^ ,a^) of the linear system 

p'ev 

Notice that this is a linear system of A^^ equations for the A^^ unknowns (w^ (p), p G P\{0}) 
and . Recall that w^{0) = is given. 

(ii) We update the optimal control by solving the A^^ minimization problems 
m^+\p) G argmm ^ {C^ip, p')w^ {p') + /-(p)}. 



Finally, the algorithm is stopped whenever the difference between a^^^ and is smaller 
than some initially fixed error. 
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4.3 The numerical results 



We present below different figures obtained with the above numerical scheme, representing 
the domain Oq and partitioning the state space in different regions depending on which 
controls are active or not. We remind once more the reader that Oq provides a first order 
approximation (j4.ip of the true no-transaction region. For later reference, we provide our 
color correspondence, where we remind the reader that corresponds to the cash account 
and 1 and 2 to the two risky assets. 



Transactions 


NT 


1/2 0/1 


0/2 


0/1 and 0/2 


1/2 and 0/1 


1/2 and 0/2 


1/2 and 0/1 and 0/2 


Color 

















and i/j indicates that a positive transfer from asset i to j, or from j to i, occurs in the 
corresponding region. 



4.3.1 Cash-to-asset only 

In all existing literature addressing either numerical procedures or asymptotic expansions for 
the multidimensional transaction costs problem, the transactions are only allowed between 
a given asset and the bank account, which in our setting translates into A*'-^ < +00, if and 
only if i = or j = 0, see for instance Muthuraman and Kumar [33j or Bichuch and Shreve 
|6]. In this first section, we restrict ourselves to this case and show that our numerical 
procedure reproduces the earlier findings. 

First, we consider the following symmetric transaction costs structure with the following 
values for a 




0.01 

-0025 -002 -0015 -0 01 -0 005 005 01 0015 02 025 

Figure 1: Uncorrelated case. 
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Figure 2: Negative correlation (left), positive correlation (right). 

As expected and in line with the results of [33j . the no-transaction region in the uncorrelated 
case is a rectangle. Then, under a possible correlation between the assets, the shape of the 
region is modified to a parallelogram, the direction of the deformation depending on the 
sign of the correlation. 

In the next Figure [3l we keep the same transaction costs structure and we consider the 
higher correlations induced by the volatility matrices: 




Figure 3: Higher correlations: negative (left) and positive (right). 

By comparing them to the first figures, we observe that modifying the correlation induces 
a rotation of the no-transaction regions. 

Our last Figure 3] for this section shows the impact of letting the transaction costs from one 
asset to the cash be higher than for the other asset. To isolate this effect we consider again 
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-0 025 -0 02 -0 015 -0 01 -0 005 005 01 015 02 025 



Figure 4: Different transaction costs. 

As expected, we still observe a rectangle but with modified dimensions. More precisely, 
transactions between the first asset and the cash account occur more often since they are 
cheaper. 

4.3.2 Possible transfers between all assets 

In this section we allow for transactions between all assets, a feature which was not con- 
sidered in any of the existing numerical approximations in the literature on the present 
problem. We start by fixing a symmetric transaction costs structure Aq, and we illustrate 
the impact of correlation by considering the volatility matrices fio, ct- and 0"+. 



0.015 
0.01 
0.005 



-0.005 
-0.01 
-0 015 




-002 -0015 -001 -0005 005 01 0015 02 



Figure 5: Uncorrelated case. 
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02 I 

0.015 I 



-0.02 
-0.025 




-0.025 -0.02 -0.01 5 -0 01 -0 005 005 01 015 02 0.025 



-0.03 -0 02 -0.01 01 0.02 0.03 



Figure 6: Negative correlation (left), positive correlation (right). 



Our first observation is that transactions between the two assets do occur, and more im- 
portantly that as a consequence, the no transaction region seems to no longer be convex, 
an observation which, as far as we know, was not made before in the literature. More- 
over, as in the previous section, the introduction of correlation induces a deformation of 
the no-transaction region. In order to insist on this loss of convexity, we also report the 
following figure obtained with the same parameters as the left side of Figure ([5]), but with 
more precise computations and without colors 



-0.03 -0.02 



0.01 0.02 



Figure 7: All transactions allowed. 



Our last figure shows the impact of an asymmetric transaction costs structure. The volatility 
matrix is set to do and the transaction costs matrix to A'. As expected, there are almost 
no transactions between the cash account and asset 1, since they are twice as expensive as 
the other ones. Surprisingly, we also observe the occurrence of small zones (in black and 
violet), where transactions are simultaneously performed between the assets and between 
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the assets and the cash account. 




Figure 8: Asymmetric transaction costs. 



5 Convergence 

In the rest of the paper, we denote for any function /(s, x, y): 

f{s, z, C) := f{s,z- y(s, z) • 1^, + y{s, z)) . 
This section is dedicated to the proof of our main result, Theorem 13.31 Let: 

u'^{s,x,y) := u'^{s,x,y) — e^w{s,z,£,), s G M"^, {x,y) ^ K^. 

5.1 First estimates and properties 

We start by obtaining several estimates of u''. Set 

A := max A*'-^ , A := min A*'-^ . 

0<i,j<d 0<i,j<d 

We also recall that L is the upper bound of the set C. 

Lemma 5.1. For (e, s, x, y) G (0, +oo) x (0, +00)'^ x K^, and z := x + y, we have 

u'(s, X, y) > -eLvz{s, z)\y - y(s, z)\ . 

Consequently, under Assumption \3.^ we have for all (e, s, x, y) E (0, +00) x (0, +00)*^ x JT^ 

< U:t:{s,x,y) < u*{s,x,y) < +00. 

Proof. Since v^{s,x,y) < v{s,z), it follows from the definition of that 

u^{s,x,y) > -e^w{s,z,^). 

Next, recall that DW takes values in the bounded set C. Since w{.,0) = 0, this implies that 
—w{s,z,(^) > — ICI Vz{s,z), and completes the proof. □ 

The next Lemma proves that the relaxed semi-limits are only functions of {s,z). 
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Lemma 5.2. Let Assumptions \3.I\ and W^ hold. Then, u* and U:^ are only functions of 
{s,z). Furthermore, we have 

u^{s,z) = lim u''{s' ,z' -y{s' ,z') -Id^yis' ,z')) 

(e,s',2')-*-(0,s,2) 

u*{s,z) = lim ^[s' ,z' -y{s' ,z') -Id^yis' ,z')). 

(e,s,z')^(0,s,z) 

Proof. We proceed in several steps. We assume throughout the proof that the parameter 
e is less than one. 

Step 1 : In view of the gradient constraints of the dynamic programming equation satisfied 
by u^, we know that for all 1 < i < d, we have in the viscosity sense 

Alo.{v^,,vl)>0, A^,,.«,t;^)>0. (5.1) 

Now define 

v^{s, z, ■■= v^{s, z-ei-ld- y(s, z) ■ 1^, + y(s, z)). 
We directly calculate that (|5.ip implies for all 1 < i < (i in the viscosity sense 

e^A^'°91(s, z, e) - e3A^'V,(5, z, + (1 + e^X^'')^. (s, z, > 0, (5.2) 

and 

e^X^'%{s,z,0 - e'X^''y,{s,z).vl{s,z,0-vl^ > 0. (5.3) 

Using the fact that all the y|(s, z) are strictly positive (see Assumption 13. ip . we can multiply 
(|5.2p by y|(s, z) and sum to obtain, once more in the viscosity sense 

V i=l / i=l 

Now, we have by Assumption 13.11 

vj,0 d 



yz[s,z)_ ^ ^ 



4 = 1 1 = 1 1=1 



Using this inequality in (15. 4|) yields, in the viscosity sense 

y,{s,z).vl{s,z,0 > -^Sr^^e'vt{s,z,0. (5.5) 
Plugging this estimate in (I5.2D and (I5.3p . we obtain in the viscosity sense 

and 

S|,(s,z,0>-2e^AT}l(s,z,0. 
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By the concavity of f"^, its gradient exists almost everywhere. Moreover, since we assumed 
that y is smooth, this imphes that also exists almost everywhere. Hence, we conclude 
from the above estimates that 



<Ae^vl, where ^ := \/dmax |a(^1 + — ) , 2a}. (5.6) 
Step 2: We now prove an estimate for v%. By definition and from Assumption 13. 1| 

vl{s, z, C) = dzv^ (s, z-ei-ld- y(s, z) ■ 1^, + y(s, z)) 

= (1 - yz{s, z) ■ Id) vl{s, X, y) + y^(s, 2).f^(s, x, y) 

<vl{s,x,y) + vl{s,x,y)-ld. (5.7) 

Therefore, we can focus on obtaining estimates on and Vy. First, by concavity of in x 
and of u in z, we have 

v''{s,x,y) -v^{s,x - e,y) 
v^{s,x,y) < 

^ v{s, z) — v{s, -2 — e) _|_ v{s, z — e) — f^(s, x — e,y) 

~ e e 

v{s,z- e) - u'(s,x - e,y) 
< Vz{s, z - e) H . 

Now, using the definition of u*^, we obtain 

<(s, X, y) < Vz{s, z-e) + e {u^{s, x-e,y) + e^wis, z - e, , 

where 

y-y{s,z-e) y{s, z) - y{s, z - e) 

?e := = ? H • 

e e 

From the estimates on w in Theorem 13.11 and Assumption 13.41 we have 

\w{s, z-e,Q\< Lv^is, z){l + IC.I) < Lv,{s, z) (l + \i\ + ly(^^ ^) " y(^> ^ " ^)l 



and therefore 

<(s, X, y) < t>^(s, z - e) + en'(s, x - e, y) + e'Lvz{s, z)[l + \i\ + 



e 

As for Vy, we use again the concavity of and f in y and z, respectively, 

v''{s,x,y) - v''{s,x,y- eci) 



vl,{s,x,y) < 



^ v{s,z) - v{s,z - e) _^ t;(g,z - e) - v'^{s,x,y - ecj) 

~ e e 

v(s, z — e) — v'^is, x,y — eci) 
<vz{s,z - e) + — ^^-^^ 0<i<d. 



Similarly as above, this yields 

vl,is,x,y) < Vz{s,z - e) + eu'^{s,x,y - eei) 



-e'Lv.is, .) ( 1 + lei + l-^^- + y(^^^)-y(^^^-^) 
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Plugging the above estimates in (j5.7p . we get 



vl{s, z, e) <(1 + d)vz{s, z-e) + e x - e, y) + ^ x,y - ee^)^ 



+ e^Lv,{s,z)[d+{l + d)[l + \i\ + 



\y{s,z) - y(s,z - e) 



(5.8) 
=:7^(5,z,e). 



Step 3 Recall that exists almost everywhere, and thus by definition of u*^, this also holds 
for u\ and u|. Now, using (I5.6p . (I5.8P together with Assumption 13.11 and our estimates on 
w, we obtain for some constant C > 

With this estimate, we can conclude the proof exactly as in the proof of Lemma 6.2 in 

□ 



5.2 Remainder estimate 

In this section, we isolate an estimate which will be needed at various occasions in the 
subsequent proofs. The following calculation extends the estimate of Section 4.2 in 
For any function 

^\s, X, y) := v{s, z) - e^(p{s, z) - e^w{s, z, 0, 
with smooth 6 and v such that v also verifies the estimates (13. 51). we have 



imis, x,y):= [/3^' - C^' - Ui^l) ) (s, x, y) 

_ ,2 



^ V:,:, + ^Tr [aa^{s, z)w^(^{s, z, Cj] - A(t){s, z) + IZ^s, z, ^) 



Similarly as in [H], direct but tedious calculations provides the following estimate: 

I P 

\n\s, x,y)\<e[\^l-T■ U \i\ l-Z-.l + ^ (2 |y| 1^1 + ee) \<t^zz\ + |^| \D,,<j)\ ) (s, 
+ eC{s,z)(l + e\i\+e'\i\' + €'\if 



+ e 



-2 



for some continuous function C(s,z). Now using the fact U is and convex and the 
estimates assumed for v, we obtain 

|7^^(s, X, <e( I// - r • U \i\ \c^,\ + ^ (2 |y| 1^1 + e^') \'Pzz\ + |^| \Dsz^\ ) (s, z) 



+ eC{s,z)(l + e\i\+e''\i\' + e^\i\' 
+ {\<P,\ + eCis, z){l + e |e|))' U" {v, + |0,| + e^Cis, z)(l + e |e|)) 
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5.3 Viscosity subsolution property 

In this Section, we prove 

Proposition 5.1. Under Assumptions \3. 1} \3.2\ and \3.4\ the function u* is a viscosity sub- 
solution of the second corrector equation. 

Proof. Let {so,zo,(j)) £ (0, +00)*^ x (0, +00) x ((0,+oo)'^ x (0, +00)) be such that 

(n* -0)(so,2o) > {u* -^){s,z), for all {s,z) G (0, +00)^^ x (0, +oo)\ {(sq, ^o)}- (5.9) 
By definition of viscosity subsolutions, we need to show that 

A(f){so,zo) - a{so,zo) < 0. 

We will proceed in several steps. 

Step 1: First of all, we know from Lemma 15.21 that there exists a sequence {s^,z'') which 
realizes the limsup for u^, that is to say 

(s', z^) — > {so, zo) and z', 0) — > u*{so, zo). 

It follows then easily that II := u'^{s'^, z'^,0) — <j){s'^, z'^) — > 0, and 

ix',y') = (z' - yis',z') ■ Id, y(s', z')) —> (xq, yo) := {zo - y{so, zq) ■ Id, y(so, ^0)) ■ 

Now recall from Assumption 13.21 that is locally bounded from above. This implies the 
existence of tq := ro(so,Xo,yo) > and eo := eo(so,Xo,yo) > verifying 

6* := sup{n'(s,x,y), (s,x,y) £ Bq, e G (0,eo]} < +00, (5.10) 

where Bq := Brg{sQ, xq, 2/0) is the open ball with radius tq and center (sq, xq, i/q). Moreover, 
notice that we can always decrease rg so that tq < zq/2, which then implies that Bq does 
not cross the line z = 0. Now for any (e, 6) G (0, 1]^, we define ^'^''^ and the corresponding 
by 

$^'^(s, z, := v{s, z) - £2 {11 + z) + $^(s, z, e)) - e\l + 6)w{s, z, i), 

where the function and the corresponding <^'^ are given by: 

¥{s, X, y) := CO [{s - s^)^ + {z - z^f + e^w\s, z, i)) , 

and Co > is a constant chosen large enough in order to have for e small enough 

^'^ <1 + — (j), on Bq\Bi, where Bi := Bj:^{so,xo,yo)- (5-11) 

We emphasize that the constant co may depend on ((f),so,Xo,y(),6) but not on e, and that 
a priori the function "^""'^ is not in ^, because the function w is only in C^'^. This is a 
major difference with the one-dimension case treated in |44) . 
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Step 2: We now prove that for all sufficiently small e and 6, the difference — vJ/'^'<') has 
a local minimizer in Bq. First, notice that this is equivalent to showing that the following 
quantity has a local minimizer in Bq 

I ' [s,x,y) : = 2 

= X, y) + 11 + (l){s, z) + (tf{s, X, y) + e^5w{s, z, 

By (jS.lip and the fact that > 0, we have for any {s,x,y) G BBq 

I"'\s, X, y) > -u'{s, x,y)+ll + l + h + e^Swis, > 1 + C > 0, 

for e small enough. Moreover, since /"^'^(s^, x*^, y^) = 0, this implies that P'^ has a local 
minimizer {s^,x'',y^) in Bq, and we introduce the corresponding 

z := X +y ■ Irf, and 4 := . 

e 

We then have 

min {v" -^'^^){s,z,i) = {v" -■^''^){s',z',t) < 0, \s' - so\ + \z' - zq\ < tq, 

for some constant ri. We now use the viscosity supersolution property of v"". Since ^'''^ is 
C^, we obtain from the first order operator in the dynamic programming equation that: 

A,^^^.- >0 for ah 0<i,j<d. (5.12) 

Step 3: In this step, we show that for e small enough, we have 

■■= ^^(1^ G Oo{s^,n (5.13) 

where Oq{s, z) is the open set of Proposition 13.21 We argue by contradiction assuming that 
there exists some sequence e„ — > such that /o^" 00(5*^", 2'^")- This implies that 

- A'o'^'o + [difw - dj^w) (s'", z'", p'") = for some (io,io )• (5-14) 

By the gradient constraint (|5.12p . and the boundedness of (s*^", i"^", e„^"^")^, we directly 
compute that: 

- AC el {enwf {s'- , z"^ , f " ) (w^.n - w^,^ ) (s^" , z^" , f " ) 

+ elv,is'"rz'") [X'^''^ - {l + 5M^^w-djsw){s'\z'",p'")] +o{el) > 0. (5.15) 

Using (|5.14p and the non- negativity of w, this implies 

< -AcoX'o'^hl{enwf{s'-,z'",e")-SX'^'^Selv,{s'-,z'") + o{el^ 
< -6X'^'^hf,v,{s'",z'-) + o(e^) > 0, 

which leads to a contradiction when n goes to +00. 



22 



Step 4: From (j5.13p and Proposition 13.21 we deduce that in our domain of interest, the 
function ^''^'^ is actually smooth, and is therefore a legitimate test function for the second or- 
der operator of the dynamic programming equation. We then obtain from the supersolution 
property of that 

Vw' - /^^''^ - Ui^^f) ) {s',x% y') > 0. (5.16) 



Moreover, by Step 3 and the continuity of (s, z) i — > 0{s,z) in Assumption [331 the sequence 
{(,^)e is bounded. By classical results in the theory of viscosity solutions, there exists a 
sequence e^i — )■ and some ^ such that 

{Sn,Zn,U) ■■= {s'",z'-,e-) (sc^O,?)- 

Now recall that the function w is smooth in this case and that the function ^'''^ has exactly 
the form given in Section 15.21 By the remainder estimate in (|5.16p , we obtain 

)^n|^ + -(l + 5)Tr [aa^{Sn,Zn)w^^{Sn,Zn,^n)] - A(l){Sn, Zn) +Tl%S, Z, ^) > 0. 

We still have no guarantee that w is at ^. Therefore, we carefully estimate the term 
involving w^^. Indeed, the equation satisfied by w yields 

a{Sn, Zn) - A(t){Sn, Zn) + & ^a(s„, Z„) - ^?7(Sn, Zn) |o-(s„)^„|^^ + TV{s, Z, ^ > 0. (5.17) 

Notice that the estimate on the remainder of Section 15.21 still hold true if terms involving 
w^(^ are replaced by means of the first corrector equation. Since the map (s, z) i — > a{s, z) is 
continuous, by Assumption 13. 4^ and all derivatives of vanish at the origin, we may send 
e to in (j5.17p and obtain 

a(so, ^o) - A(t>{so, zo) + 6 (^a{so, zq) - ^??(so, zo)\a{so)i\^^ > 0. (5.18) 

Since ^ is bounded uniformly in 5, we let 6 go to zero in (15.18^ to obtain the desired 
result. □ 

5.4 Viscosity supersolution property 

In this section we will prove the following result. 

Proposition 5.2. Under Assumptions \3. i\ \3.S\ and \3.4\ is a viscosity supersolution of 
the second corrector equation. 

To prove this result, we start by two useful lemmas. For the first one, we recall that in the 
proof of the viscosity subsolution property in the previous section, we mentioned that the 
function w is not C'^ in the whole space. We overcome this difficulty by using the fact that 
we only needed w on a subset of M'^ where it is actually smooth. However, in the proof of the 
viscosity supersolution property, we need w to be defined on the whole space. Therefore, we 
mollify it and the following Lemma gives some useful properties satisfied by this mollified 
version of w. 
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Let A; : M'^ — )• M be a positive, even (i.e. k{—x) = k{x) for all x G M*^), C°° function with 
support in the closed unit ball of M'^ and unit total mass. For all m > 0, we define 

k"^{x) := ^k(^ and w^{s, z,i) := f k^{Ow{i - QdC - f A;™(C)«;(-CMC. 

Lemma 5.3. Let As sumption \3.4\ hold. For any m> 0, the function w"^ satisfies: 
(i) is C^, convex in ^, and we have for all < i, j < d 



w^^{s,z,0 = / A;™(CK,(s,z,e-CK, w^^.is,z,0 = / A;-(CK^5, (s, ^ - CK- 
Moreover, < ii;™(s,z,0 < Lvz{s,z) |^| . 

(ii) w'"^ is smooth in {s,z), and satisfies the following estimates, uniformly in m, 

(|^-| + |^-| + |^-| + |^-| + |^-| + |^-|) ^s,z,0 < C{s,z) (1 + lel) 

{\nj^\ + \yj^^\ + \yj^^\)(s,Z,0<C{s,z) 

\w^^{s,z,0\ <C{s,z)li:^B{s,z), (5.19) 

where C{s,z) is a continuous function depending on the Merton value function and its 
derivatives, and B{s,z) is small ball with continuous radius and center in {s,z). 

(iii) For every < i, j < d and every {s,z,^) 

-X^'^v^is, z) + w^^{s, z, - w^^{s, z, i) < 0. 

(iv) For every {s,z,^), we have 

lv,,{s, z) [ k^{x) \a{s){i - 01' dC - \tt [aa^(s, z)w'^^{s, z, 0] + a{s, z) < 0. 

Proof, (i) The fact that w"^ is in ^ is a classical result. Moreover, we have by definition 
w"^{s,z,0) = and by convexity of w, we have w"^ > w > 0. The equalities for the 
derivatives of w"^ follow from the fact that w is in ^ and almost everywhere. Finally, 
inherits clearly the convexity and Lipschitz property of w. 

(ii) is clear by linearity of the convolution and Assumption 13.41 (iii) is again a consequence 
of the linearity of the convolution and the gradient constraints satisfied by w. Finally (iv) 
follows from the linearity of the convolution, the second corrector equation satisfied by w 
and the formula for given in (i). □ 

We next constructs a useful function which plays a major role in our subsequent proof. 

Lemma 5.4. For any 5 G (0, 1), there exists > 1 and a function h^ : ^ [0, 1] such 
that h^ IS C°°, = 1 on Bi{0) and h^ = on B^s{Oy. Moreover, for any 1 < i < d and 
for any ^ G M*^ 

4(o| < ^ifi .(o)(e), and lei \hy < c*, 

for some constant C* independent of S. 
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Proof. Let <j) be an even C°° function on ]R+, whose support is in ( — 1,1), such that 
< < 1 and j^-^ (j){t)dt = 1. For some a > to be specified later, we define the fohowing 
function /i° : R+ — > [0, 1]: 



haix) :-- 



H'^ix - t)^{t)dt, where := 1{,<2} + M - aln ( - J J l{2<.<2ei/<^}- 



Clearly, ha is C°°, /iq = 1 on [0,1] and to /i^ = for [1 + 2e^^",oo). Moreover, ha is 
decreasing and its derivative clearly verifies for every x G M 



a 



0>h'a{x)>--. 



We claim that 

xh'aix) 

Indeed, this inequality is obvious on (— oo, 1], and we compute for x > 1, that 



< — for all xeR. 
4 



(5.20) 



(5.21) 



< Xh'aix) 



ax 



We now introduce the function: 



/a^(j){t)dt < I a-(f>{t)dt 



3a 



Clearly h^ is C°°, takes values in [0,1], h^ = 1 on So(l), and h^ = on B^_^2^L/s{0y. In 
particular, this provides the existence of E [1, 1 + 2e~^]. Also 



Thus, by (|5.20p and the fact that h? and all its derivatives vanish on (0*^,00): 



4(0 < ^1b^,(o)(x). 



Similarly, we have 



1^1 4,(0 = ( lei mm - h'sm ) ^ + h'^nm- 



Consequently, using (|5.20p . (|5.2ip . and the fact that 5 G (0, 1), we have for some constant 
C which only depends on the dimension d: 



ICI 141 < c 



35 6 6 \ 3C 



4LA 4LA 2LA 



2LA 



□ 



Proof. [Proposition [52] Let (so,zo,0) G (0, +00)^+^ x ((0,+oo)^+i) be such that 
{u^ - (/))(so, zo) < {u^ - (/>)(s, z), for all (s, z) € (0, +00)"^ x (0, +oo)\ {(sq, ^o)}- (5.22) 
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By the definition of viscosity supersolutions, we need to show that 

A(j){so, zq) - a(so, zq) > 0. (5.23) 
We argue by contradiction and assume that 

A(t){so, Zq) - a(so, Zq) < 0. (5.24) 

Then by the continuity of (p and a, for some ro > 0, we will have 

A(j){s,z) — a{s,z) < on Brg{so,ZQ) for some ro > 0. (5.25) 

Step 1: This first step is devoted to defining the test function we will consider in the sequel. 
First of all, we know from Lemma [5.21 that there exists a sequence (s*^, z*^) which realizes the 
lim for 2^, that is to say 

(s^ z") — > {so, zo) and u^s", z", 0) — > m*(so, ^^o)- 
It follows then easily that II := u^{s^, z^,0) — (pis^, z'') — > 0, and 

{x\y^) = {z^ - y(s', z') • Id, y{s\ z')) (xq, yo) := (^o - y(so, ^^o) • Id, y(so, ^^o)) • 
We then choose eo, depending on zq, sq and (j), such that for all e < eo, we have 

k^-^o|< J, N^-so|< J, ICI<1- (5.26) 
By the continuity of (j) and v^, we may also introduce a constant cq > such that 

_sup {<P{s,z) + v,{s,z)} + 2, < 2co(j)\ (5.27) 

(s,z)G-BrQ/2(«0,2o) 

Notice that since (j) and Vz are continuous, the supremum on the compact set B{sq, zq, ro/2) 
above is indeed finite. This justifies the existence of cq. We now define 

ip'^{s, z) := (j){s, z) — Co ^1^; — z^l^ + N — •s'^l'^^ • 
Then, for all e < eo and for any (s, z) G B^^i2{so, zq), we have using (|5.27p and (j5.26p 

ip''{s, z) + 11 + Vz{s, z) = (j){s, z) + Vz{s, z) - cq[\z- z"^ + |s - s^f^ + I* 



4 



< 2co j - 3 - Co \^\z - z^l +\s-s' 



4 

< 



+ 1 



Co (^2 (^^y -\z- z'\^ -\s- - 2 < -2, (5.28) 
whenever {s,z) G dBj.^/2i^0j ^o)- 

Before defining our final test function, we provide another parameter. Let > be greater 
than the diameter of the open bounded set Oo(so, ^o), and fix some ^* > 1 V .^o V ^* where 

1/2 



4 := sup 



1 + 2a{s, z) + ^*+^ Tr [aa^{s, z)] Vz{s, . 

1 I |2 
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and C* is the constant appearing in Lemma l5.4f iv). Then, for any ^ G i?^*(0)^, it follows 
from (|5.25p that for any (s, z) € B^^I2{sq, zq): 

\ (J* _j_ 'x^^ 

- |c7^|^ i-Vzz){s, z) ^ Tr [aa^] Vz{s, z) - A(t){s, z) > I + 2a{s, z) - A(p{s, z) > 1. 

(5.29) 

Finally, for S G (0, 1) and m > 0, let be the function introduced in Lemma 15.41 w"^ the 
function introduced in Lemma |5.3| and define the test function x, y) and the 

corresponding ip'''^'"^{s, z,^) by 

z, := v{s, z) - eVis, z) - e^l - e\l - 5)w^{s, z, i)H{i), m) ■= h' 

Step 2: In this step, we modify the test function once again in order to recover the interior 
maximizer property. We first compute that: 

r''^'™(s,z,0 := e-'^{v' -^''^''^){s,z,i) 

= ^\s, z) - u\s, z, + C - [1 - (1 - 5)H (0] w'^is, z, 0- (5.30) 

In particular, this implies 

pAni^^e^ Z% 0) = (/)(s^ Z') - U'{s', z' , 0) + I* = 0. (5.31) 

Furthermore, since < v, we also have easily 

P'''^{s,z,C) < ip'{s,z)+i: + e\l - 5)H{0w^{s,z,0. (5.32) 

Now, we use the fact that 

0<S<1, Vz{s,z) > 0, < H{^) < l\^\<as^' and < w'^{s,z,^) < Lvz{s,z) \^\ , 

in (|5.32p to obtain 

l'''''^{s,z,0 < ^'{s,z) + i: + e^L{l-6)H{0v.{s,z)\C\ 

< ip''{s,z) + 1* + e^Lvz{s,z)a^^* < (p''{s, z) + I* + Vz{s, z), (5.33) 

provided that e < e"^ := (La^^)"^^^- 

Define the set Qsq,zo ■= {(-^j-ZjO) i^^^) ^ Brg{so, zq)"^ . Let us then distinguish two cases. 
First, we assume that {s,z,^) G OQsq^zq for every ^. Then, if we take e < eo A e"^, using 
(|5.28p and (j5.33p . we obtain that for any ^ 

/^'^''"(z,^) < -2. (5.34) 

We assume next that (s, z,^) G int (Qsq.zo)- Then, once again for e < e*^ A eo, we have 

r'^'"(z,C) <¥^^(s,z) + /: + z;,(s,z) <C(so,^o) <+oo, (5.35) 
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for some constant C{so,Zo) depending only on (j), sq and zq, since {s,z) lies in a compact 
set, I* < 1 and all the functions appearing on the right-hand side of (j5.35p are continuous. 
This implies that 

i/(e,(5,m):= sup /^'^'"(s, z, < +00. 

(s,z,C)6Qso,zo 

By definition, we can therefore for each n > 1 find (s'n; E int (Qso.zo) such that 

r'^''"(s„,?„,Cn) > He,S,m) - i-. (5.36) 

Since we have no guarantee that the maximizer above exists, we modify once more our test 
function. Let / be an even smooth function such that /(O) = 1, f{x) = if |x| > 1 and 
< / < 1. We then define the test function "^'''^'"^''^{s,x,y) and the corresponding 

^.A-,n(,^ Z, ■■= ^'"'""{8, Z, - -/(IC - Cnl) ■ 

n 

Consider then 

/^'^'-'-(s, z, ■■= e-^ (r - ^^''^'™'") {s, z, = I-'^'^'is, z, + (IC - Cnl) . 
Notice now that for any {s,z,(,) G Qsq.-zo' have using (|5.36p 

= r'^''"(sn,2-n,en) + - > z^(e,5,m) + ^ > r^^'"'is,z,C) + ^. (5.37) 
n 2n zn 

Moreover, by the definition of /, we have: 

r''5''"'"(s,z,e) = r'''"^(s,z,0 if C^^BiiUr and {s, z,0 e Qso,zo- 
This equality and ()5.37p imply 

sup r''^''"'"(s,z,o = _sup r'^'"''''{s,z,0- 

Since i?i(^„) n Qso,zo is a compact set, we deduce that there exists some (s„, Zn,£,n) £ Qso.^o 
which maximizes J"^'^'"*'". "We now claim that we actually have {sn, Zn,^n) G int(Qso,zo)- 
Indeed, we have by (|5.3ip 

/^'''"^•"(sn,^„,en) > r'''™'"(/,/,o) > r■^•"^(/,z^o) = 0, 

and, by ([Qi]) . 

r'^'™'"(s,z,e) < r'''"(s,z,o + ^ < -2 + i < o,(s,z,o G 5g,„,,„ for (s,z,e) G sg,^,,,,. 

By the viscosity subsolution property of v'' at the point {sn, Zn,£,n), with corresponding 

{Sn,Xn,yn), it folloWS that 



mm 

0<j 



dn ^ - r^'^'^''"'" - U l^^^''^'"^'") , A,^_j. • (*^''^'™'", ^^''''"^'")} < 0. (5.38) 
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Step 3: Our aim in this step is to show that for e small enough and n large enough, we 
have: 



l,J \ X 1 



^f''"'")(s„,x„,y„) > foraU < i,j < d. (5.39) 



We easily compute for < i < d, with the convention that = x and cq = 0, that: 

^^f '-'"(s, X, y) = v,{s, z) - eV|(5, z) - e\l - 6){w^H)^[s, z, ^.(e. - y.(5, z)) 

" 1^-41 



and 



[A^'^,(s„,z„) - (1 - 5){w'^H)^{sn,Zn,in).{ei - e,)] - - F^'", 



where 



:= \''^ [e\c^,{sn, z„) - 4C7(z„ - z' f) + e\l - 6){w"'H)^{sn, Zn,^n)■{e^ - y^isn, Zn))] 
+ X''^e''il-6)iwTH)isn,Zn,U), 

Recall that ^* > 1. Then, from Lemma 15.41 we have 

0<H <1, \H^\ < ^ and H = for 1^1 > a^C, 

we deduce 

\E'\ < X^'^e' [<P,{Sn, Zn) + 4co \Zn " + eC(so, Zo) {\wf\H + w''' \Hi:\) (s„, in) 
+e^LVz{Sn,Zn) \in\ 1h(C„)>o] 



< C(so,^o)e^ 



1 + 6(1 + 0")+ e^a^(. 



(5.40) 



for some constant C{sq^zq) which can change value from line to line. Then we also have 
easily for some constant denoted Const, which can also change value from line to line 



|F^'"| < Const-. 

n 



(5.41) 



Let us now study the term 

: = - (1 - 5){w'^H)^.{ei - ej) 

= y,3y^ _ (1 _ 5)(^- _ ^-)^ _ (1 _ 5)w"^iH^, - H^^), 

where we suppressed the dependence in (sn, Zn,in) for simplicity. Using Lemma [5.3( 111) and 
the fact that w"^ and H are positive, w"^ < Lvz \(,\ and H = for ^ > a^^* 

> X''^v, - X''^{1 - 5)v, - (1 - 5)Lv, ICnl (1^1 + 1^5,1) 



Li* 



>X^^^v-^(5-^{l-5){\H^^\ + \H^^\)], 
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since > 1. But by (iii) of Lemma 15.41 we know that for all < i, j < d, \H^^\ < 
from which we deduce 

G' > \''^^v,. (5.42) 

Finally, we have obtained 

> xiJS^v.e^ - C{so, zo)e^ (l + e (l + a^^ + e^a^^*) - Const^. 

Next, there is by hypothesis some constant C > such that Vz > C, and therefore there is 
a such that for all e < e^: 



Then, for alU n>N^s-= we have 



Const— < . 

n 4 

We then conclude that, for e < e*^ and n > N^^^, we have > X^'^'^Ce^ /2 > 0, and by 
the arbitrariness of i, j = 0, . . . ,d, we deduce from (I5.38P that 



je,5,m,n ^ 

— ,2 



Step 4: We now consider the remainder estimate. Using the general expansion result, we 
have 

2 

je,5,m,n ^ (_^^^)^|^ + l-^Tr [ao^ {wH)^^] -AcP + n, (5.44) 

where 

and using the same calculations as in the remainder estimate of Section 15.21 



\TZ~\ = 



\T^<i)\ ^ Const 

,„ , Const 
l%l < 



Ui^'f'^n - U{vz) - e^U (0,) 

2 



< Const ( e + le^nl H — 
n 



n 



\n^H\ < Const [1 + |e^r j (e + \^^\ + e l^nl) %„|<a^e- 
We deduce from all these estimates that there is a and a such that if e < and 



n > Nf:, we have 



|7^| < 1. 



Step 5: For n greater than all the previously introduced A^'s and e smaller than all the 
ones previously introduced, we now show that |^„| < 
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We argue by contradiction and we suppose that |^„| > Then we know that w^{.,S^n) = 0. 
By ()5.43p . the expansion (|5.44p . and the result of Lemma l5.4r iii).(iv). we see that: 



I I 1 (5 

(-Vzz{Sn,Zn)) J A4> < [ao^ {Sn, Zn)iw'^ H)^^{Sn, Zn, ^n)] - 



< -^y^Tr [aa^isn, z„) (^'"i^gg + 2u;g//f )] + 1 

< Vz{sn,Zn)^—^TT [aa^(s„, z^)] \H^^\ + 0+1 

Tr [aa (s„,z„)J \C +=1+1, 



< 



contradicting (|5.29p . Hence is bounded by ^* (which does not depend on e, 5, m 

or n). In particular, this implies that the function H applied to is always equal to 
1. Therefore, by the boundedness of (sn,^n,Cn) and by classical results on the theory of 
viscosity solutions, there exists some ^ such that by letting n go to +oo and then e to 
(along some subsequence if necessary) in (|5.44p . we obtain by using Lemma 15.31 (iv): 

> -Vzz{so,zq)^-^^^^^^^ + ^^-y^Tr [aa^ {so, zo)wf^{so, ZQ,Ci\ - A(t){sQ,zo) 

> (1 - 5)a{so, zq) - 5vzz{sq, zq)^^^^^^^ A(t){so, zq) 

+ ^-^Vzz{s,,zo) [ A;"(C)(k(so)(e-C)l'-k(5o)Cf)dC. (5.45) 



Since k'^{C,) |(t(so)C|^ dC, — > 0, and ^ is uniformly bounded in m and 5, we can let 5 



2 

Now using the fact that the function A;™ is even, we have 

A;™(C)(k(^o)(e-C)P-k(so)C?)dC= / A;-(C)k(5o)C|'dC. 

and m go to in (|5.45p to obtain 

A(f>{so,zo) - a{so,zo) > 0, 

which is the required contradiction to (j5.24p , and completes the proof of the required result 
([OS]) . □ 

6 Wellposedness of the first corrector equation 

In this section, we collect the main proofs which allow us to obtain the wellposedness of 
the first corrector equation (j2.5p . Since the variables {s,z) are frozen in this equation, we 
simplify the notations by suppressing the dependence on them. 

Recall that since the set C is bounded, convex and closed, the supremum in the definition 
of the convex function 6c is always attained at the boundary dC. Moreover G int(C), we 
may find two constants L,L' > such that 

L'\p\<6cip)<L\p\. (6.1) 
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6.1 Uniqueness and comparison 

Proof of Theorem 13.11 Fix some {e,u) G (0, 1) x (0, +oo) and define for {p,y) € M'^ x R'^ 

1 2 

uf{p, y) ■■= (1 - e)wi{p) - W2{y), (t)u{p, y) = ^\p-y\ ■ 



Since wi is a viscosity subsolution of (|2.5p , then its gradient takes values in C in the viscosity 
sense, which implies that wi is L— Lipschitz. Then, for y ^ 0: 

w^{p,y) - 4>u{p,y) = (1 - (^){wi{p) - wi{y)) - ^ |p - + (1 - e)wi{y) - W2{y) 

1 2 

< (1 - e)L \p-y\- — \p-y\ + (1 - e)wi{y) - W2{y) 

< ^ + (1 - e)wi{y) - W2(,y) 



2 ^''^'\^'-'hciy) Sciy)J 
By the growth conditions on wi,'W2, together with (j6.ip . this implies that: 

lim w%p,y) - 4>u{p,y) = -oo. 
Then, the difference ttJ*^ — (py has a global maximizer 

(^pe,iy^ye,iy^ G M'^ X M'^ Satisfying the 

lower bound 

{w^ - cl,,W''',fn > {w^ - 0.)(O,O) = 0. (6.2) 

By the Crandall-Ishii Lemma (see Theorem 3.2 in [12]), it follows that for any rj > 0, there 
exist symmetric positive matrices X and Y such that 

{-DyMp'''',y'n,Y) = (^P-l^Jtl^Y^ e j'''w2{y'n, (6.3) 

and 

[-1 _;)<^+-M^ with 

The above matrix inequality directly implies that X <Y . We now use (|6.3p to arrive at 

P^'-'-y^'-' ^ , 

In addition, since wi is a viscosity subsolution, Dwi G C in the viscosity sense. This implies 
that for all < i,j < d. 



€,1/ e,u 

(l-e)z^ (l-e)z^ 



€,1/ 
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Since e G (0, 1), we have 



<_tl ^<A*J, and therefore ^ ^ g int(C). 

V V V 



Consequently, it follows from (|6.3p and the viscosity subsolution and supersolution of w\ 
and W2 that 



Tr [ao^X] + ai < < - \ - T^Tr [aa^F] + 02- 



2 2(1 - e) L J ^ - - 2 2 

Since X < y, this provides: 



(1 - e)ai - aa < -Tr [aa (X-y)J + (l-e) — ^ < — . (6.4) 

We now show that {y^'" , p^'") ^ remains bounded as u tends to zero. 
• We argue by contradiction, assuming to the contrary that 

|ye,^'n| — y £qj. gQj]2e sequence — > 00. 
Since wi is Lipschitz, this implies that 

{w^ - 0.„)(p^'^",y^'^") < + W'''")j^^^{My''''") - ^2(/''^")). 

Arguing as in the beginning of this proof, we see that (uf — (f>u„)ip^''^" ,y^''^") — > —00, 
contradicting (16. 2p . 



Similarly, using the normalization Wi^O) = 0, we have 



Since {y^''^")n was just shown to be bounded, we see that Ip*^'*^"! — >• 00 implies {w'' — 
~4'u„){p'^''^" ,y'^''^") — ^ —00, contradiction. 

By standard techniques from the theory of viscosity solutions, we may then construct a 
p"" G R'^ and a sequence (t'n)n>o converging to zero such that (p*^'*^", y*^'*^") — > {p^^p^), as 
n — )• 00. Passing to the limit in (16. 4p along this sequence, we see that (1 — e)ai — 02 ^ 0, 
which implies that ai < 02 by the arbitrariness of e S (0, 1). □ 

The following uniqueness result is an immediate consequence. 



Corollary 6.1. There is at most one a € M such that (j2.5p has a viscosity solution w 
satisfying the growth condition w{p)/ 5c {p) — > 1, as \p\ — )• 00. 

Remark 6.1. (i) In the context of |24| . C is just the closed unit ball, then it is clear that 
5c{p) = \p\, and the growth condition in the previous result reduces to W{p)/\p\ — > 1, as 
IpI 00. 

(ii) In the one-dimensional case d = 1, we directly compute that Sc{p) = X^'^p'^ + X^'^p~ . 
So the above growth condition is the sharpest one for the explicit solution of (j2.5p given in 
Section 4 of [H. □ 
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6.2 Optimal control approximation of the first corrector equation 

In ergodic control, it is standard to introduce an approximation by a sequence of infinite 
horizon standard control problems with a vanishing discount factor r/ > 0: 

^ _ Ixr [acFD^Wip)] + vw^p), 



max max 

0<i,j<d 



together with the growth condition 



lim f4^ = l. (6.6) 

\p\^+<^5c{p) 



We first state a comparison result for the equation (I6.5p -( l6^ . The proof is omitted as it is 
very similar to that of Theorem 13.11 

Proposition 6.1. Let 101,11)2 be respectively a viscosity subsolution and a viscosity super- 
solution of (16. Sp . Assume further that 

Then, wi < W2- In particular, there is at most one viscosity solution of (j6.5p . 

The next result states the existence of a unique solution of the approximating control prob- 
lem. 



Proposition 6.2. For every 77 G (0, 1], there is a unique viscosity solution of (|6.5p - (|6.6p . 

Moreover, w'^ is L-Lipschitz {with a constant L independent of rj), and we have the following 
estimate 

{5c{p) - Ki)+ < w'^ip) < ^ + Sc{p), p G M'^. (6.7) 

V 

Proof. In view of the previous comparison result, we establish existence of a viscosity 
solution by an application of Perron's method, which requires to find appropriate sub and 
supersolutions. The remaining properties are immediate consequences. We then introduce: 

^(p) := i^cip) - Ki)^ , and ^(p) ■= ^ + 1{<5c(p)<i}-^^^ + 1{<5c(p)>i} (^^c{p) - ^ • 

(i) We first prove that we may choose Ki so that is a viscosity subsolution of the equation 
(16. sp satisfying the growth condition ()6.6p . Since w has linear growth, 6c is Lipschitz and 
vanishes at 0, we may choose Ki > such that ro(/9) < |(t/>|^ /2 for all p S W^. 

Moreover, w is convex and has a gradient in the weak sense, which takes values in C, by 
definition of the support function. Then, for all po G W^, and {p,X) G J'^'~^^{po): we have 
X > 0, p G C , and therefore: 

max max < — ^ ^'^^ Tr [aa^^X] + r]w_{pQ), —A*'-' + Pi — Pj > 



0<i,j<d 



< max max < — — 1_ jy^^pj,) _|_ _ p . I < g. 

0<i,j<d 2 — ^ ' J I 
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Hence, mis a viscosity subsolution. 

(ii) We next prove that w is a viscosity supersolution of the equation (j6.5p satisfying the 
growth condition (j6.6p . for a convenient choice of K2. Consider arbitrary po G R'^ and 
{p,X) G j2'-ro(po). 

Case 1 : Sc{po) < 1, then /jq must be bounded. Moreover, by definition, W is Lipschitz. 
Hence, p ^ C and X > 0. In particular, p is bounded and by the definition of J'^'~w{pq) so 
is X. We then have 



-Tr [aa^X] + rjw{po) > - -Tr [aa^X] + K^. 



2 2 L J , V, - 2 2 

Since po a-ud X are bounded, we may also choose K2 large enough so that the above is 
positive. This implies the supersolution property in that case. 

Case 2 : 6c{po) > 1, then w has a weak gradient which, by definition of the support function, 
takes values in 9C, i.e. at least one of the gradient constraints in (j6.5p is binding. This 
implies that the supersolution property is satisfied. □ 

We next establish that vf^ is convex, by following the PDE argument of [23]. Notice that 
this property would have been easier to prove if the probabilistic representation of Remark 
13.11 was known to be valid. 

Lemma 6.1. uf is convex and therefore is twice differentiable Lebesgue almost everywhere. 

Proof. 1. Let e G (0, 1), p^,p^ £ M'^, p := (p° + /?^)/2, and let us first prove that 

t{p^,p'):={l-e)w'^{p)-{w^{p'>)+w^{p'))/2^-oo as \{p^ , p^)\ ^ oc. 

Let {pn,Pn) GR^ xR'^ be such that | + |/9^| — > 00. Denote pn ■= {Pn + Pn)/'^- For large 
n, we have dc{Pn) + ^dPn) > 0, and using the convexity of dc we also have 

dM) + 6M) ^ 'Uc{p'n) + SM) '^i^^^5c{p\,) + 5c{pV)5c{pl) 
^ l-ew^{pn) 1^ 5c(pj,) tU^Pn) 



2 



5c{Pn) 2 Scipi) + 6c{pl-') Scipi) 



Consider first the case where ((5c(Pn))„ is bounded, which is equivalent to the boundedness 
of ( \pn\ )^ by (|6.ip . Then it is clear by the growth property (16. 6p that A„ — > — ^ < 0. 
Similarly, if 5c{Pn) — > 00, we see that limsup„_^co ^ [(1 ~ ^) ~ < 0. In both case 
this proves the required result of this step. 

2. For e = {p'^,p^,y^,y^) G M^"', set p := (p° + p^)/2, y := {y^ + y^)/2, and define: 



m ■■= (1 - ^)w\-p) - (u^(y°) + w\y^))/2, Me) := n (jp" - y^f + \p^ - yf ) /2. 
Since uf is L-Lipscliitz, we have 

{w^-M{e) = {i-e)[{w\p)-w\y)]-MO)+^%y'',y^) < < t{y'',y^) + L'/n. 
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By the first step, this shows that (w^ — (j)n){&) — > —oo as \9\ — > oo, and that there is a 
global maximizer On := (p^, p^, y^, Dn) of the difference w'' — (f)n- Using then Crandall-Ishii's 
lemma and arguing exactly as in the proof of Proposition 13.11 (see also the proof of Lemma 
3.7 in [24]), we obtain that for all {p^,p^) 

il-e)w\p)-{w^{p'')+w\p'))/2 < (l-e)w\pn)-{w^iy'n)+w\yi))/2 

< (2|ap„|2-|ay0|2-|ayi|2)/(4r,). (6.8) 

Following the same arguments as in the proof of Proposition 13. H we next show that the 
sequence {dn)n is bounded, and that there is a subsequence which converges to some 6^ := 
{p^, p^,y'^,yl). The averages p^ and y^ are introduced similarly. Passing to the limit along 
this subsequence in (|6.8p . we obtain for all {p^,p^): 

n{{l-e)w^{p)-[nf{p^) + w^{p')]/2) < {2\apf - \ap',f - \aplf) < 0. 

The proof is completed by sending e to 0. □ 
As a consequence of the convexity of w^, we have the following result. 

Lemma 6.2. There is a constant M > independent of rj such that J^~w^{p) C dC , for 
all p £ Bq{MY. 

Proof. Let K2 be the constant in Proposition 16.21 Since 8c has linear growth, we can 
choose M large enough so that 

K2 + Sc{y) < for ah \y\ > M. 

Fix yO € M*^ satisfying \p\ > M. Then, by the convexity of w^, p G J^'^nf{p) if and only 
if p belongs to the subdifferential of vif^ at p. This implies, in particular, that p £ C. 
Furthermore, we have (p, 0) G J'^'~w^{p). Then, the supersolution property of ItJ'' yields 

max max < h rjw'^{p), — A*'-' + Pi — Pj\ > 0. 

0<i,j<d I 2 I 

By the definition of M, we have — ^-^ — h r]w^{p) < — ^-^ — \- K + Sc{p) < 0, and therefore 
max | — A*'-' + Pi — Pj} > 0. Since p £ C, this means that this quantity is actually equal 

0<i,j<d 

to zero, implying that p G dC. □ 



The following result is similar to Lemma 3.10 in [24]. 

Lemma 6.3. For Lebesgue almost every p G M"^, we have < D'^w^{p) < ^ \\aa'^\\ . 

Proof. We fix e G (0, 1) and z £ such that < |z| < M which we will send to zero 
later. Set 

^(p) := (1 - e)iw'^{p + z)+ w'^ip - z)) - 2w'^{p). 
Since Uf is Lipschitz, 

i){p) < 2(1 - e)L \z\ - 2w'^{p) < 2(1 - e)LM - 2w'^{p). 
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In view of the growth condition (j6.6p . as p approaches to infinity ip{p) tends to minus 
infinity. Let 

/3(pi,P2,P3) := (1 - + z) + w\p2 - z)) - 2w\p;), 



and 



1 / 2 2 

<l}v{pi,p2,pz) ■■= i^[\pi- P?,\ +1/32 -Pal 



We then have, again by the Lipschitz property of vif ^ that 

(/3-(A^)(pi,P2,P3) = {l-e)(w'^{pi + z)-w'^[p^ + z) + w'^{p2 + z)-w'^[p^-z)) 



+V'(/53) - ^ ( 1/51 - PsI +\P2-P^[ 



< L^u + i;{p3) 



-oo, as \p\ — )• c«. 



Hence there exists {Pi-, P2^ Pz) which maximizes /3 — By applying Crandah-Ishii's lemma, 
for every p > 0, we can find symmetric matrices {X, Y) € S^'^ x S'^ such that 



i-Dp,MPi,P2,P3),Y) G J''~2w^{p^,), 



and 



/ X 

-Y \ <A + pA^ 
y 



(6.9) 



where 



A :-- 



D-'Mp'i.p'i.pl) 



/ /rf -Id \ 

Id -Id 

-Id -Id 2Id 

\ / 



For {Xi,X2,X3) G S'^ X M^^'^ x S'^, set X := 



Xi X2 

'■2 



XT X3 



Then, (j6.9p implies that 



and in particular, Tr [Xi + X3 — y] < 0. 
We directly calculate that 

^^^,Xi) G J''^ (Pi ^ (1 - e) (^n^Cpi + z)+w^{p^2 - z))) 
G (p2 ^ (1 - e) {w'^ip'i +z)+ nf{p2 - z))) 



P2=P2 
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Since is a viscosity subsolution of (j2.6p . we deduce that for all < i,j < d 

^ Pl,i ~ P''^,i _ Pl,j ~ Ptj < 

il-e)u (l-e)i/ 

and 



. P2,i Pz,i P2,j Psj ^ ^i.j 
From this we deduce that for all < i, j < d 

< PM + P2. - 2P3. _ Ph + P^2, - ^Pl, < 

2eu 2(1 - e)i/ 

Since e G (0, 1), this implies that G int(C). Also ^'^+f G J^'~w^{p^^). Given 

that W is a viscosity supersolution, we deduce that 



2 2 

Since ItJ'' is a viscosity subsolution, 

k(pr + ^)i' 



aa — 



^— ^Tr [oa^Xi] + Tiw^ip'; + z)<0, 



2 2(1 -e) 

and 

_ ^^Tr [aa^Xs] + v^^ip^, -z)<0. 
Summing up the last three inequalities, we obtain that for all p ^ W^, 
(1 - e) {W'^ip + z)+ W{p - z)) - 2W{p) < (1 - e) {w'^ipl + z) + W^p^i - z)) - 2W{p'i) 
< ^Tr [aa^(Xi + X3 - Y)] + + + W2 " 



2r? L ^ - - /J 2r? V " ' "7 r\ 

< ^ (KPi f + WiP2 - z f) - (6.10) 



2r] 

We argue as in the proofs of Proposition 13.11 and Lemma |6.H to show that {p\, P2, p^) is 
bounded and that there is a subsequence and a vector p* such that they all converge to p* 
along this subsequence. Using this result in (I6.10p . we obtain 



r? ((1 - 6) {w^p + z) + w\p - z)) - 2w^{p)) < \ (|a(p* + z)| V W - z)f) 



I * 1 2 

\<^p I 



< llcrcr'^ll \z? . 



where we used the mean value theorem and the fact that the Hessian matrix of the map 
p — )• |cjp|^/2 is 00^ . 

We finally let e go to 0^, divide the inequality by \z^ and let \z\ go to zero to obtain the 
result, since we know that the second derivative of nf^ exists almost everywhere. □ 

Corollary 6.2. (i) uT'' G C^'^l 
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(ii) The set 

Or, := {/9 G M'^, Dw'^ip) e int(C)} . 
is open and hounded independently o/O < r/ < 1. 

(iii) G C°°{0^). 

(iv) There exists a constant L > independent of ij such that 

< D'^Wip) <L, p£ Or,. 

Remark 6.2. Now that we have obtained some regularity for the function , we could hope 
to prove that it is indeed the value function of an infinite horizon stochastic control problem 
by means of a verification argument. However, the problem here is that the verification 
argument needs to identify an optimal control, which we can not do in the present setting. 
Indeed, we do not know whether the solution to the reflexion problem on the free boundary 
defined by PDE (j2.6p has a solution, since we know nothing about the regularity of the 
free boundary. Notice that such a regularity was assumed in |31j in order to construct an 
optimal control. 

Proof. The first result is a simple consequence of the previous Lemma 16.31 For the second 
one, the fact that Or, is bounded independently of rj follows from Lemma [6.21 and it is open 
because it is the inverse image of the open interval (— oo,0) by the continuous application 

f • • dw^ dw^ 1 
o<i,3<d [ dpi dpj J 

Then the third result follows from classical regularity results for linear elliptic PDEs (see 
Theorem 6.17 in [21J), since we have on O^ 

- ^Tr [aa^D^w\p)] + qW'^ip) = 0. 
Finally, by convexity of uf^, we have for any ^ such that |^| = 1 and for any p G Or, 

eD^w^{p)i < CoTV [acFD'^w^p)] = 2Co (^w\p) - < 2Co(K2 + 5c{p)), 

and the result is a consequence of the fact that Or, is bounded. □ 

In the following result, we extend Proposition 3.12 of |24) to our context and show that 
is characterized by its values in Or,- The proof is very similar to the one given in |24j . We 
provide it here for the convenience of the reader. 

Proposition 6.3. We have for all p G , w^{p) = iiif {uf{y) + Sc{p — y)} ■ 

Proof. First of ah, since uf^ G C^'i(M'^), it is easy to see by the mean value Theorem and 
the fact that Dw^ G C that for all {p, y) x 

-Sc{y - p) < w'^ip) - w'^iy) < Sc{p - y)- 
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Hence we have w^{y) + 5c{p — y) > w^{p). This imphes that for p G 0^ we have 

inf {w'^{y)+6c{p-y)} = w'^{p). 

It remains to show that the result also holds for p £ O^^. Notice first that by convexity of 
TZJ^, the minimum in the formula is necessarily achieved on dOr^. Define then 

w'^ip) ■■= inf {w''{y) + 6c{p-y)}. 
yedOr, 

Let us then consider the following PDE 

max + - =0, p€0; 

o<i,j<d{ dpi' dpj^'^' \ 

V{p)=w\p), padOr,. 

It is easy to adapt the proof of Proposition 13. II to obtain that this PDE satisfies a comparison 
principle. Since vif clearly solves it, it is the unique solution. Then by the usual properties 
of inf-convolutions, it is clear that the function which is convex, has a gradient in the 
weak sense which is in C. This implies that w"^ is a subsolution of the above PDE. Moreover, 
since 5c also has a gradient in the weak sense which is in dC (by convexity) , using the fact 
that by properties of the inf-convolution of convex functions, the subgradient of at any 
point is contained in a subgradient of 5c, we have that w'^ dominates every subsolution 
of the PDE which coincides with on (90^. By usual results of the theory of viscosity 
solutions (see |12] ) this proves that w'^ is also a supersolution. By uniqueness, we obtain 
the desired result. □ 

Corollary 6.3. For Lebesgue almost every p G O^, D'^w^(p) = 0. Hence, the second deriva- 
tive ofw"^ is bounded almost everywhere, independently of rj in the whole space M*^. 

Proof. Let p £ O^. By Proposition 16.31 there exists y G dOrj such that w^{p) = w^{y) + 
5c{p — y)- We then have for any z 

Wjp + z) + w^jp -z)- 2W{p) _ W{p + z)+ w^{p -z)- 2uf{y) - 25c{p - y) 
\z\ \z\ 

dcjp + z-y) + 6cip - z-y) - 25c{p - y) 

— I |2 

\z\ 

Now, the function p — t- 5c{p) is continuous and clearly C°° almost everywhere (actually 
except on d{d+ 1) hyperplanes which therefore have Lebesgue measure 0). More than that, 
this function is piecewise linear, which implies that its Hessian is null almost everywhere. 
By letting \z\ go to above, we obtain the desired result. The last result is now a simple 
consequence of Corollary I6.2r iv) . □ 

Then, the uniform estimates obtained above allow us to prove our main existence result in 
Theorem I 
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Proof of Theorem 13.21 By the uniform estimates of Corollary 16.31 we may follow the 
arguments of Section 4.2 in |24| to construct a strictly positive sequence (r/n)n>o converging 
to zero, a G M and w G C^'^(M'^) such that 

lim rjnw'^^ip^") =a, and Itf " — > uJ in ^^^(M'^), 

where p^" is a global minimizer of w^" . Corollary 16.21 implies that the limiting function w 
satisfies the required properties. □ 
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